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The Appalachian Regional Commission (ARC) 'saw^ the 
sixth Applied Technology Satellite (ATS*6) as a means of improving 
the' quality of inservice teacher education by distributing high 
qualify courses frbm a central \source. There were 15 classroom sites 
scattered from New York to Alabama; the basic television rece-ptioh 
equipment cost approximately $4^000 per site."^ Five of the 15 sites 
were also equipped to receive and transmit 2-way radio via ATS-3. ^ 
There were U major learning activities: (1) 30-ininute, pretaped 
televised programs which included 'lectures, interviews, and 
demonstration teaching; (2) audio ireviews of the pretaped television 
programs; (3) live seminars which allowed students to ask questions 
of their teachers and^ other experts'; and (4) resource librai^ies at 
each site. There is a one-page summary of each of the fo.llowing: 
evaluation strategies; how wei;L did 1 the equip utent work; how well di'd 
the ^system for relaying semina:r questions work; what were the 
participants like; how well did the participants like the different 
learning activities; how much/ did the participants learnj did the 
participants become convinced of the values of course , concepts and 
procedures; are the teachers lising the skills learned; and 
conclusions. (KKC) \ ' - ^ . 
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'Uast May the National Aeronautics and Space Administra- 
tion Ta'uhche'd the sixth in its series of Applied Technology 
Satellites (ATS). Various experiments were planned to show 
different ways the satellite might be used. One of the ATS-6 
telecommunications experiments, sponsored by the National Insti- 
tute of Education, is the Appalachian Education Satellite Project 
(AESR);. . ^ / . 

The Appalachian Regional Commission (ARC)., established 
to .promote the overall development of the Appaleichi^n region, 
saw/ATS-6,as a:means of improving the quality of inservlce .edu- 
cation by distributing high quality courses from a central: source. 



/iBased on a paper presented by Dr. Bramble, the Director of 
Evaluation for the Appalachian Education Satellite Project, at 
the 1975 annual meeting of the American Educational Research 
A'ssociatibn, April 1, 1975, in Washingtoni D.C, as part of a 
symposium entitled "Major Communications Satellite Demonstra- 
tion for Education, Health, and Technology. ^ 



Audio-Video and-Two-Way/ Radio Reception 

Equi piTien t at Mai n SI te 1 n Cuniberl and , ' Mary! and 



ARC realized thaic costs fo** reception equipment are a major fac- 
tor In Appal achi a where needs may be great, but communities can 
least afford the expense, for this reason ATS-6 was especially 
appropriate, since the basic TV reception equipment it required 
was Inexpensive, costing approximately $4,000 per site, compared 
to hundreds of thousands of dollars for previous satellite re- 
• ception systems. 

For the AESP demonstration, there were 15 classroom 
sites scattered from New York to Alabama, These sites are des- 
ignated by circles 1n,F1gure L All 15 sites were equipped to 
receive pretaped and l^lve programs via ATS-6, The sites are 
, located at ReglonalEdUcation Service Agencies (RESAs), Five 
/ of the 15 sites, called main s1tes>were also equipped to re- 
ceive and transmit two-way radio v1a-ATS-3, The main sites are 
identified in Figure 1 by an asterisk. The black triangles in 
Figure 1 show the 2 ancillary sites associated with each main 
' site. 



I CHAUTAUQUA RESA 



[MARYLAND RESA^^^^^^^ 



OILEKOWISCO RES 



^^^^^ 



CLINCH-POWELI 



(RESA • 



TARCOGRESA 



FIG. 1 MAP OF THE APPALACHIAN REGION 
SHOWING THE FIVE RESA CLUSTERS, RECEIVXHG 
TRIANGLES, AND APPROXIMATE SATELLITE FOOT 
PRINT. 
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Fredonia, N.Y. 
oicAii, N.y.. 
Edinboro, pa. 
Cunbofland, Md. 
McHcnry, Md. 
Keyset f W. Va. 
Norton, Va. 



H. Sticklyvillc, Va, 



I. Doonc, N.C* 

J. Johnson City, Tcnn. 

*K, LaFollcttc, Tonn. 

L. Coalfield, Tcnn. 

*M, Huntsvillc, Ala. 

N. Rainsvillc, Ala. 

0. Cuntcravillc, Ala. 
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The University o\' Kentucky was chosen as the Resource 
Coordinating Center (RCC) for the development of course materials. 
(See AESP Technical Report #2 [Ausness & Bowling] for more de- 
tailed background Information.) The RCC designed the following 
learning activities to exploit different capabilities of ATS-6 use 
alone and sometimes- in bonjunct1bn w1th-ATS-3: 




1) A major learning activity was the series of 30 
minute, pretapod tel evised programs . They differed 
- from-most-graduate -level-lectures: in-that -they were^ — 
punctuated with filmed ihtervt^ews of content ex- 
perts arid teachers and short episodes showing actual 
Appalachian teachers applying instructional tech- 
. niques in their-classrooms. 
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f Teachers at Cumberland, Maryland site 

Preparing to Watch a TV Program 



2) Another satenite-dellvered learning activity was a 
series of audio reviews of the pretaped TV programs . 
These made use of the four-channel audio capacity of 
ATS-e. Each review consisted of a question describ- 
ing a hypothetlcaV teaching situation and four alter- 
native approaches to the problem. The. student se- 
lected the response he felt was most appropriate by 
depresslnga button 'on his response pad. He then 
heard an explanation of the .merits of his response. 
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Werner \on Braun, Vice President.pf Engineer- 
ing and Development, Fairchild Industries, 
.taking part in four-channel audio review 



3) Live seminars , forum in format, made it possible for 
stuHents to ask their teacher and other experts 
questions durjing a live broadcast. Seminar ques- 
tions were relayed from the 10 ancillary sites by 
landline teletype .to the five main sites for VHF 
transmission 'to the broadcast studio via ATS-3. 
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Career Education Seminar I n-progress at the 
University of Kentucky Broadcast Studio 



4) The students had resource libraries at each site 
which Included materials selected to complement 
each course. They also- had access through ATS-3 
to run searches for instructional materials using 
cowputerized Information retrieval systems . 
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Some of the other classroom activities in the course did 
not depend-on satellite delivery. For instance,, in laboratory 
sessions the students had the opportunity tOi apply what they 
learned in the televised programs. Immediate feedback on the 
unit tests helped the students determine how well they under- 
stood the material covered in each unit. ^ 




Students at Fredonia, New York Doing Labora- 
tory Exercises 



ERLC 
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EVALUATION STRATEGIES 



During the development of these learning activities, the 
AESP .Evaluation- Component Implemented a number of evaluation 
strategies to provide information useful in product development* 
Some of the f ormati ve eval ua ti oh activities carried out while 
prpducts were being developed included: 1) providing descrip- 
tive information on the region, 2)'^1dent1fying, rfbr filming, 
classes where principles central^to the courses were-being 
applied, 3) Implementing procedures for field review of scripts 
by teachers and content experfs^^ performing experiments, to 
determine the most ^ffect^iVe. sequences and formats for the 
learning activft^es, and 5) carrying out audience reaction 
studies to identify spots in programs that needed reworking* 

In the audience reaction study, for example, the partic- 
ipants indicated at different points in a semifinal version of 
a program whether they were interested in what was being pres- 
ented. In Figure 2 are the ratings for the program* The hori- 
zontal axis identifies the points in. the program (in minutes U 
when the reviewers were asked to rate, and the vertical axis' 
Identifies the average ratings assigned by the viewers* The 
closer to five the more interesting and the closer to 1 the 




\ 
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\ 

\ 

GRAPH OF AUDIEl^CE REACTION TO TELEVISED LECTURE 

'11 \ ' 
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\ Filming Exemplary Programs Used by 
* ^Appalachian Teachers 



less interesting the participants found that section v/he rat- 
ings, ^on the average, were near the positive (5) end ^ of the 
scale. Most of the high peakk o1> interjest occurred during ^ 
classroom sce/ie^s showing teachers appli(ing the.procedu*^s with 
actual students. Interest was tissual ly , less during studio shots 
of the narrator; (See AESP Technical Report #3 [Bramble, / 
Ausness, & Wetter] for more detailed information on formative, 
evaluation study.) / 

Some of the summat i ve e val ua ti on a ct i vi t1 es carried out 
after products were f1 nail zed to determine their effecti veness ^ 
included: 1) unit tests, 2)1pre- and post achievement tests, - 
3) pre- and post attitude tests, 4) pre- and post teaching^ 
practices inventories, 5) user ratings of the quality of the- 
learning activities, 6) equipment checklists, and 7) cost 
studies comparing alternative formats, (See AESP Technical ' 
Report #4 [Bramble, Ausness, Wetter, & Harding] for more .detailed 
description of summative evaluation* activities*) The data 
collected and analyzed by the AESP Evaluation Component^pro- 
-vide- .-preliminary-^answers for many question? asked about the 
effectiveness of the satellite-delivered- courses-,^ — 
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HOW WELL DID THE EQUIPMENT USED TO DELIVER AND 
RECEIVE THE TELEVISION PROGRAMS WORK? 



As-1nd1cated In Figure 3, the delivery system Includes i 
the satellite, the access station equipment, and the landllne > 
(inks between the broadcast studio apd the uplinks This dell v- 
€ty s^&n was Inoperative dur1ngr4 bf the first 48 ^programs 
ti^mited; that Is, It was operatlve-'QZrpercent of ^the time. 

ny there were only two transmission 'failures, jdue once to 

"a malfunction :1n* the telephone link between the television studio 
and the uplink and another time to a malfunction In Avpower 
transformer at the uplink. The delivery system should have 
ajhlgher rellabllUy In the future, /since these ^'i^'.res are based 
on the first six- months of use. 

\ " ' ATS-6 




, FIGURE 3 - AUDIO-VIDEO DELIVERYSYSTEM 
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AsMri^dlcated in Figure 4, site reception equipment for 
the AESP coursesJncTuded all ground equipment at the site nec- 
essary for receptw^o^aucllo-vldeo and the four audio signals. 
The receptlpri system at Individual sites was operative 98 per- 
cent of the time. Procedures^for making; up missed programs 
were Implemented for/feach failure; thus participants were ulti- 
mately exposed to the total, course content. 




HOW WELL DID THE SYSTEM FOR RELAYING 
' SEMINAR QUESTIONS WORK? 



As depicted in Figure 5 equipment failures In the re- 
laying of seminar questions could occur In the 1 and! Ine teletype 
connection between the ancillary and the main sites. In the VHF 
equlpinent at the mairi sites. Including the helical antenna. In 
the satellite Itself, \ or In the VHP equlpinent at the broadcast 
studio.. The teletype ^and VHP site reception transmission equip- 
ment were operational |96 percent of the time, the VHP equipment 
at the broadcast studio was operational 91 percent of the time. 
The lower reliability at the broadcast studio was due primarily 
to initial problems with locaf radio Interference; (See AESP 
Technical Report #5 [Bramble, Ausness,-& Preeman] for a more de- 
tailed description of equipment functioning.) 



'AlS-3 




ANCILLARY SITE 



] 



FIGURE 5 - VHF- TELETYPE RELAY SYSTEM 
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WHAT WERE THE PARTICIPANTS WHO TOOK THE COURSE LIKE? , 

As Indicated 1n table 1, there We 291 partici- "^"x 
pants in the Diagnostic and Prescriptive Reading Instruction 
course for K-3 teachers (DPRI); 246 in the Career Education 
course for elemen'tary schooV teachers (CEE); and 248 in the 
Career Education course for secondary teachers (CES). As indi- 
cated below the typical participant was a woman in her mi d- 
:thirties-who had taught^9-10 years, but had not completed her 
master's degree or taken many graduate courses In the course 
subject.. As might be e)(pected more of the participants in the 
courses for elementary teachers were women, and more of the 
participants in the courses for secondary teachers had cfdvanced 
'degrees* J- 



TABLE 1 

BACKGROUND CHARACTERISTICS OF COURSE PARTICIPANTS 



Characteristics 


DPRI 

y 


CEE- 


CES 


Number 


291 


246 


248 


X Females 


93!6 


m 


m 


Average Age (years) 


35 


36 


35 


% Teachers . 


m 


m 


m 


Teaching Experience (years) 


9 


9 


10 


^ Masters Degree 








Average Graduate Courses In Area' 


1 


0 


.5 
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HOW WELL DID THE PARTICIPANTS LIKE THE 
DIFFERENT LEARNING ACTIVITIES? 



Table 2 shows the amount of Information the course partic- 
ipants felt they received from the^lnstructlonal activities, com- 
pared to similar on-campus activities; A rating of 3, on a one 
to five scale, means the activity was perceived as equivalent to 
a similar bn-campus activity In conveying Information. Ratings 
for the teVevlsed programs greater than 3 meao the participants 
thought the televised programs were better in conveying Infor- 
mation than-typlcal on-campus lectures. The average ratings for 
the televised seminars, which center around 3,5, Indicate that 
the participants perceived them=as slightly superior to on-campus 
graduate seminars. The laboratory exercises, audio reviews, and 
retrieval Information systems ratings were judged respectively 
to be somewhat superior to on-campus laboratory sessions, class 
quizzes, and supplementary materials. All the means are signif- 
icantly above the neutral ratings of 3.0 at the .05. level. (See 
AESP Technical Report #6 [Marlon, Bramble, & Wetter] and #7 
[Harding, Bramble, & Marion] for more detailed Information on user 
reactions to learning activities.) 



TABLE 2 

TEACHER RATINGS OF LEARNING ACTIVITIES 



Learning Activities ^ CEE CES 

Mean^ SE Mean SE Mean SE 



Pretaped TV Programs 


4.0 


.06 


3.5 


.07 






Live, Interactive Seminars 


3.6 


.07 


3^4 


.08 


3.5 


.12 


Laboratory Exercises 


3.8 


.06 


3.6 


.06 


3.3 


.12 


Audio. Reviews 


3.5 


.07 


3.5 


.07 






Infpmiati on Retrieval 














Systems 


3. -8 


.07, 


3.6 


i07 


■3.6 


.14 
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HOW MUCH DID. THE PARTICIPANTS LEARN? 

In Table 3 Is the average percent of Items the parti c1- 
p2\nts answered correctly, on the pre- and posttests for each 
course. From the entrance level it can be seen the course 
participants /were, oh the average, familiar with the content of 
4he course* However, there vyas still a 15 percent gain In knowl- 
edge of course concepts after exposure to the reading course 
activities, and a 12-13 percent ga1n-,1n knowledge after comple- 
tion of the, career education course activities. The pre-post 
gains on the achievement, tasts for all three courses were sig- 
nificant at the .05 level when variation among sites was removed. 



TABLE 3 



CWNGES IN KNOWLEDGE-^OF COURSE CONCEPTS 
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DID THE PARTICIPANTS BECOME CONVINCED OF THE VALUES 
OF COURSE CONCEPTS AND PROCEDURES? 

In Table 4 are the average Item means for the pre- and 
post-attitude questionnaires In each course. While the pre- to 
post/gains on these Attitude questionnaires were smaller than 
those on the achievement tests, they are positive In direction 
arfii-slgnlf leant at the .05 level when variation among sites was 
removed. The greater change in attitude In the secondary career 
education course may be; due to^ Its longer length, 16 weeks 
conpared to 8 weeks for^the elementary courses. However, It 
should be pointed but that the effectiveness of alT the courses 
In changing measured attitudes about the codrse materials was 



relatively smal 1 . \ 










TABLE 4 




•* 


MEAN ITEM GAINS 


(IN AniTUDE QUESTIONNAIRES 




Item Information 


f - - - 
DPRI 




CES 


Pre-Average Response 


2.97 




3.91 


Post-Average Response 


3.06 


3.98 


4.13 


Average Item Gain 


.09 ^ 


M 


.28 


Number of Items 


23 


25 


28 




/ / 



18 

ARE THE TEACHERS IN THEIR CLASSROOMS USING 

. THE SKILLS LEARNED IN THE COURSE?' 

■ ' - ' 1 . 

In a follow-up study of the reading and eleniientary/ 
career education course, 50 course participants were randomly 
selected from each course to report the extent to whlch they 
had used information learned In the sumtner courses. All 19 CEE 
respondents and 3a of the 35. DPRl respondents who returned the 
questi onnal re, sal d they .1 earned many useful skills they were 
actually applying In their classroom* The remaining 2 DPRI 
respondents said they felt the skills they learned were useful 
but not applicable In: their s'ltuatlon. These Illustrative 
comments made by teachers Indicate the Impact the course has 
had on their classroom teaching: ^ 

"Attitudes toward reading have Improved," 
"All; have progressed at a more' rapid pace than last year." 
"Host effective techniques I have ever usedT" 
"The .children are very excited^" 
"Pupils have developed better .atti tudes and more 
ambition for the future," 

Other conments made by the teachers Indicate those who 
took the reading courseware applying what they learned more than 
those who took the career education course. This may be due to 
the fact that reading techniques are more easily substituted for 
previous methods of Instruction, while the career education 
techniques often Involve more extensive curr1culum;redeveloi3ment. 
. The point to note Is that, even though the measured changes In 
^attitude were small, the teachers seem to be applying In their 
classrooms the Instructional techniques learned In the AESP 
courses. (See AESP Technical Report #8 [Marion, Bramble, & 
Ausness] and #9 [Bramble, Marlon, & Ausness] for detailed inform- 
ation^ regarding changes In participant knowledge,, attitude and 
behavior.) . ^ • * " 
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WHAT CONCLUSIONS CAN BE DRAWN FROM THE RESULTS 
• JUST DISCUSSED? 

# It Is technically, feasible using satellite delivery 
and i nexpiensi ye ground reception-equipment to 
provide graduate edQcation courses to students 
scattered over large geographical areas. / 

0 Site representatives who are non-content experts 
can administer these courses, when provided with 
sufficient instructions and easy access/to the 
Resource Coordinating Center by way of /two-way 
radio. ' / 

-% The course participants preferred the learning 
activities in the satellite-delivereii courses' 
to on-campus graduate education courses with 
which they were familiar. ^ / 

• Participants :in the courses typically gained in 
knowledge pf the course content/and are now ' 
applying>What they learned in their classrooms. 

■- /■ / 

In a less-than-two-year period the ^Appalachian Education 
Satellite Project ^will have produced and: implemented four 
graduate 'courses for delivery via, satellite to approximately " 
1200 teachers. The delivery of such graduate education courses 
by satellite may be one way to expand the educational opportu- 
nities available to Appalachians^^ ^ 

../.'/■ 




Dr, Harold Morse 
Appalachian Regional Cocrmlsslon 
1666-Ccnnectlcut Avenue 
^Washington, p;G., 20235 

Dr. David L. Larlmore 
Resource Coordlnatlng-Center 
306 Frazee Han 
University of Kentucky . 
Lexington, KY 40506 

Ms. Stephanie Bennett ^ 
Chautauqua Board of Cooperative Educational 

Services (BOCES) 
Box:250 

Fredon1a,NY 14063 
Mr. Doug Cross 

CI Inch-Powell, Educational Cooperative 
^ Harrogate, TN 37752 

Mr. Mor ley Jones 

DILENOWISCO Educational Cooperative ^ 
1032 Virginia Avenue 
Norton, VA 24273 

Dr. William Br1sh 
Maryland RESA 
no Washington Street 
Cumberland, MD 21502 

Mr. Chuck Nickel 
TARESA 

2603-C Leeman Ferry Road 
Huntsvnie, AL 35801 



Mctures and diagrams supplled^by RESAseind RCC 
Television and Evaluation Components; cartoons by 
Dianne Marion. 
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Additional copies can be obtained from the 



Appalachian Education Satellite Project 
Evaluation Component 

301 Frazee Han 
University of Kentucky 
Lexington, Kentucky 40506 
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Kentucky. 

This report was produced under a grant from the National Insti- 
tute of Education. The views expressed do not necessarily re- * 
fleet those of the NationaV Institute of Education or the U.S. 
Department of Health, Education, and Welfare. 



